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FOREWORD 


Learning  tactical  skills  on  the  battlefield  is  costly;  learning 
tactical  skills  short  of  a  real  combat  environment  is  difficult.  Yet 
this  is  precisely  the  Army's  training  mission — training  troops  in  tac¬ 
tical  skills  and  constantly  improving  the  effectiveness  and  efficiency 
of  that  training. 

In  1971  the  Army  Research  Institute  for  the  Behavioral  and  Social 
Sciences  (ARI )  with  the  Army's  Training  and  Doctrine  Command  (TRADOC) 
initiated  research  which  led  to  development  of  a  tactical  training 
method  now  known  as  tactical  engagement  simulation  training  (ES) .  Two 
tactical  engagement  simulation  training  techniques  have  been  implemented 
Army-wide:  SCOPES  (Squad  Combat  Operations  Exercises  Simulation)  for 
infantry  squad  training  and  REALTRAIN  for  armor,  antiarmor,  and  com¬ 
bined  arms  training. 

Engagement  simulation  training  was  designed  to  require  the  same 
tactical  behaviors  as  does  actual  combat.  The  REALTRAIN  model  is  based 
on  a  number  of  learning  principles  that  have  been  demonstrated  to  be  im¬ 
portant  for  effective  training.  Probably  most  important  is  that  the 
competitive  nature  of  REALTRAIN  exercises  provides  motivation  to  learn, 
an  element  often  lacking  in  Army  training. 

The  potential  of  engagement  simulation  training  has  been  demon¬ 
strated.  For  this  potential  to  be  realized  fully,  further  research 
has  been  required  to  refine  current  engagement  simulation  training  tech¬ 
niques  to  make  them  more  effective  and  to  extend  these  techniques  to 
other  applications.  This  report  describes  the  use  of  tactical  engage¬ 
ment  simulation  for  the  measurement  of  unit  proficiency,  with  emphasis 
on  the  objective,  rather  than  subjective,  performance  assessments  that 
can  be  made  using  ES. 

This  research  was  part  of  a  larger  research  program  which  is  re¬ 
sponsive  to  the  requirements  of  Army  Project  2Q763743A773  and  the 
TRADOC  System  Manager  for  Tactical  Engagement  Simulation  of  the  U.S. 

Army  Training  Support  Center,  Fort  Eustis,  Va. 
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AN  APPLICATION  OF  TACTICAL  ENGAGEMENT  SIMULATION  FOR  UNIT 
PROFICIENCY  MEASUREMENT 


BRIEF 


Requirement : 

To  develop  techniques  for  objectively  measuring  the  combat  pro¬ 
ficiency  of  Army  units  and  teams. 


Product: 

The  training  system  called  tactical  engagement  simulation  (ES) 
also  assesses  the  training  results  objectively,  using  casualty  exchange 
ratios  and  mission  accomplishment  data  as  "product  measures."  Armor- 
antiarmor  exercises,  for  instance,  use  records  of  casualties,  time, 
and  mission  accomplishment  to  measure  the  total  skills  of  the  units. 

ES  training  and  assessment  procedures  have  been  developed  for  infantry 
and  armor-antiarmor  units  and  are  under  development  for  other  types  of 
unit  and  mission. 

"Process  measures"  to  assess  performance  and  skills  during  a  mis¬ 
sion  are  also  necessary,  to  help  diagnose  problems  and  explain  product 
data,  and  to  assess  noncasualty-producing  missions.  For  instance,  the 
performance  of  armored  cavalry,  whose  primary  mission  is  reconnaissance 
and  security,  must  be  judged  entirely  by  process  measures.  The  records 
and  observations  of  process  measurement  also  provide  a  way  to  note  and 
evaluate  external  factors  such  as  weather  that  affect  the  mission. 


Utilization : 

Difficulties  in  meas-,  ,-g  team  performance  using  existing  judg¬ 
mental  techniques  h_ve  been  a  fundamental  problem  in  diagnosing  pro¬ 
ficiency.  ES  measures  may  aid  the  situation  greatly. 
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AN  APPLICATION  OF  TACTICAL  ENGAGEMENT  SIMULATION 
FOR  UNIT  PROFICIENCY  MEASUREMENT 


INTRODUCTION 

The  need  for  methods  of  measuring  team  and  unit  proficiency  and 
the  lack  of  knowledge  in  this  area  are  widely  recognized.  Difficulties 
in  measuring  team  performance  are  fundamental  problems  in  unit  profi¬ 
ciency  diagnosis  and  training  evaluation  in  both  military  and  civilian 
settings  (Blum  &  Naylor,  1968;  Defense  Science  Board,  1975).  Existing 
combat  unit  performance  measurement  techniques  depend  largely  on  judg¬ 
mental  data  and  often  do  not  evaluate  the  unit's  ability  in  the  field 
(Hayes  et  al.,  1977).  Researchers  must  solve  these  measurement  problems 
before  they  can  substantially  improve  unit  training. 

A  tactical  training  system,  called  engagement  simulation  (ES)  ,  uses 
objective,  accurate  casualty  assessment  that  offers  a  potential  means  of 
measuring  team  performance  in  combat  training.  Objective  casualty  as¬ 
sessment  provides  the  primary  measures  of  team  proficiency,  such  as  casu¬ 
alty  exchange  ratios  and  mission  accomplishment.  Recent  advances  in  ES 
procedures  have  further  improved  its  uses  for  assessing  tactical  perfor¬ 
mance.  This  paper  reviews  application  of  ES  to  unit  measurement,  with 
emphasis  on  lessons  learned  while  validating  ES  procedures  for  armor 
units  and  developing  ES  for  armored  cavalry  units. 


ENGAGEMENT  SIMULATION 

ES  techniques  provide  realistic  tactical  training  under  conditions 
that  simulate  the  complex  modern  battlefield.  In  addition  to  casualty 
assessment,  characteristics  that  contribute  to  the  realism  of  ES  are 
the  use  of  two-sided,  free-play  tactical  field  exercises  and  simulation 
of  weapons  effects  and  signatures. 

Objective  casualty  assessment  is  achieved  when  a  soldier,  looking 
through  a  6X-power  telescope  mounted  on  his  rifle,  correctly  reads  a 
3-inch,  two-digit  number  on  the  helmet  of  an  opposing  unit  member.  The 
telescope  power  and  helmet  number  size  have  been  calibrated  to  produce 
hit/kill  probabilities  realistic  for  the  weapon's  lethality.  When  the 
soldier  fires  a  blank  cartridge  and  correctly  identifies  the  opposing 
helmet  number,  a  casualty  is  assessed.  A  controller  with  the  fire  team 
radios  the  helmet  number  to  a  controller  with  the  opposing  team,  who 
informs  the  "hit"  soldier  (U.S.  Army  Infantry  School,  1975). 

Analogous  objective  casualty  assessment,  weapons  effects,  and 
signature  simulation  procedures  have  been  established  for  infantry, 
armor,  and  antiarmor  elements,  including  these  weapons  systems:  M60 
tank  main  gun;  mines;  hand  grenades;  machineguns;  and  light  (LAW), 
medium  (DRAGON),  and  heavy  (TOW)  antitank  weapons.  For  longer  range 
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weapons  than  the  rifle,  the  controller  is  equipped  with  optics  to  sight 
individual  helmet  numbers  and  numbers  on  panels  attached  to  vehicles. 

In  the  tank,  for  example,  the  controller's  telescope  is  mounted  in  the 
breech  of  the  mam  gun.  When  the  controller  in  the  tank  determines 
that  the  gun  is  centered  on  a  target  at  the  time  of  simulated  round 
impact,  he  assesses  a  casualty.  The  controller  then  radios  the  number 
of  the  hit  to  the  controller  with  the  opposing  team. 

The  radio  net  over  which  controllers  announce  the  casualties  is 
used  by  senior  controllers  to  administer  the  exercise  and  is  monitored 
by  personnel  who  record  the  hits.  The  monitors  write  the  trme,  target 
number,  and  firer  number  on  a  net  control  sheet,  and  they  check  that 
the  hit  was  confirmed  by  the  controller  in  the  target  vehicle. 

All  ES  systems  provide  some  way  of  identifying  casualties.  The 
REALTRAIN  system  uses  telescopes  and  numbers,  a  system  that  has  been 
used  for  training  with  opposing  forces  as  large  as  reinforced  platoons. 

A  Multiple  Integrated  Laser  Engagement  System  (MILES)  has  been  devel¬ 
oped  to  achieve  tactical  realism  in  larger  units.  MILES  uses  low-power, 
eye-safe  laser  transmitters  mounted  on  each  weapon.  Each  target  (ve¬ 
hicle  or  soldier)  has  solar  cell  detectors  that  receive  the  laser  sig¬ 
nal  as  either  a  hit  or  a  near  miss.  Hrts  activate  a  buzzer  on  the  tar¬ 
get,  which  can  be  silenced  by  deactivating  the  target's  laser  transmitter. 
The  lasers  are  pulse  coded  to  differentiate  weapons'  effects  le.g., 
rifles  can  kill  individuals  but  cannot  destroy  tanks).  Use  of  the  lasers 
reduces  the  need  for  human  controllers  but  also  reduces  the  amount  of 
data  available  on  tactical  activitres. 

ES  differs  from  some  of  the  more  common  simulation  techniques,  such 
as  board  games  and  computer  simulations,  in  that  it  is  conducted  in  the 
field  with  a  full  complement  of  soldiers  and  equipment.  Although  ES 
uses  tactical  equipment,  it  emphasizes  human  behavior:  It  is  man- 
ascendant  rather  than  machine-ascendant.  ES  emphasizes  tactical 
decisions — reactions  to  events  that  emerge  during  competition  with  a 
motivated,  intelligent  adversary.  The  cues  to  which  soldiers  must  re¬ 
spond  are  similar  to  those  to  which  they  respond  in  battle,  and  the 
situation  changes  as  a  result  of  their  actions.  Thus,  the  situation 
is  emergent  rather  than  prespecified,  highly  predictable,  or  amenable 
to  analytic  solution  (Boguslaw  S  Porter,  ldt>6)  . 


PERFORMANCE  ASSESSMENT 

The  objective  casualty  assessment  in  ES  provides  some,  but  not 
all,  of  the  necessary  performance  measures.  Casualties  (target,  filer, 
and  time)  are  the  primary  criteria,  but  relying  solely  on  casualties 
makes  it  difficult  to  determine  why  they  occurred.  Additional  obser¬ 
vations  or  measures  of  active  performance,  are  required  when  the  final 
outcome  is  not  an  adt quate  index  of  skill  (Cronbach,  1960).  Measures 
of  processes  or  intermediate  task  and  training  objective  performance 
assist  in  training  diagnosis  and  explanation  of  product  data. 


An  example  is  the  detection  and  engagement  of  the  enemy  at  the 
maximum  possible  range  during  defensive  missions.  Particularly  at  com¬ 
pany  level  and  below,  there  is  little  recognition  of  the  importance  of 
observation  posts  to  provide  exact  and  timely  information  about  the 
enemy.  In  exercises  between  relatively  untrained  units,  most  critical 
decisions  and  actions  occur  along  the  forward  edge  of  the  battle  area. 

As  the  units  become  more  sophisticated,  leaders  in  the  defensive  unit 
spend  more  effort  on  selecting  observation  post  positions,  planning 
communications  and  indirect  fire,  and  positioning  long-range,  direct- 
fire  weapons.  As  a  result,  detection  and  effective  engagement  ranges 
increase . 

Tactical  outcomes  depend  upon  several  factors  other  than  the  pro¬ 
ficiency  of  the  units:  interactions  among  force  mix,  missions,  weather, 
and  terrain  can  influence  tactical  results.  For  example,  weather  inter¬ 
acts  with  force  mixes,  since  poor  visibility  favors  dismounted  troops 
to  the  disadvantage  of  long-range  weapons .  If  visibility  improves  dur¬ 
ing  the  tactical  action,  then  the  advantage  reverts  to  the  long-range 
weapons.  Because  of  such  interactions,  the  outcome  does  not  necessarily 
indicate  the  relative  proficiency  of  the  opposing  forces.  The  impact  of 
external  factors  must  be  considered  in  evaluating  the  results  of  an 
exercise . 


Problems  arise  in  both  recording  behavior  (active  performance  or 
processes)  and  encoding  the  environment  (such  as  the  external  factors) . 
Thus,  observational  field  research  needs  a  system  for  detecting,  measur¬ 
ing,  and  recording  the  events  and  the  pertinent  factors  (Sells,  1966). 

Literature  on  ratings  and  observational  performance  assessment 
techniques  in  criterion  development  offers  suggestions  for  improving 
field  measurement  (Blum  &  Naylor,  1968;  Goldstein,  1974;  Guilford, 

1954;  Simon,  1969;  Wherry,  1952).  Observations  and  ratings  of  behavior 
can  suffer  from  unreliability  and  inaccuracy  due  to  a  variety  of  error 
sources.  First,  the  performance  itself  is  variable,  since  people  per¬ 
form  better  at  some  times  than  at  others.  This  is  especially  true  in 
emergent  situations,  where  a  given  behavior  may  not  be  required  in  a 
specific  instance  or  may  be  altered  to  suit  the  situation.  Second, 
detection  or  observation  of  behavior  is  unreliable.  An  observer  may 
not  detect  a  given  behavior,  and  different  observers  may  perceive  and 
assess  behavior  differently.  Third,  the  recording  of  behavior  intro¬ 
duces  error,  depending  on  the  type  of  record.  For  example,  recording 
events  as  they  occur  reduces  error  by  decreasing  recall  or  memory  ef¬ 
fects.  Despite  these  error  sources,  observations  and  other  judgmental 
measures  continue  to  be  the  most  frequently  used  type  for  performance 
criteria  (Blum  &  Naylor ,  1968) . 

Improved  measurement  can  be  achieved  when  the  researcher  (a)  speci¬ 
fies  and  defines  as  concretely  as  possible  the  behaviors  to  be  observed, 
(b)  requires  data  collection  personnel  to  observe  but  not  to  judge  the 
behavior,  (c)  trains  the  observers  fully,  and  (d)  requires  observers  to 
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record  their  observations  immediately  on  clear,  concise,  easy-to-use 
forms.  The  following  sections  discuss  how  we  applied  these  principles 
and  used  observational  techniques  in  conjunction  with  objective  measures. 

OBJECTIVE  MEASURES 

The  use  of  casualty,  time,  and  mission  accomplishment  data  is  de¬ 
monstrated  by  results  from  the  validation  of  armor  REALTRAIN  (Scott  et 
al.,  1978).  Teams  composed  of  tanks,  heavy  antitank  weapons  (TOWs) , 
and  artillery  forward  observers  were  pretested  against  a  similarly  com¬ 
posed  opposition  force  (OPFOR) .  Half  of  the  tested  teams  then  had  a 
week  of  REALTRAIN  training,  while  the  others  had  conventional  tactical 
field  training.  The  teams  were  posttested  against  the  OPFOR.  Casualty 
data  show  that  the  teams  were  similar  in  pretest  performance  (each  bar 
in  Figure  1  represents  52  vehicles) .  Posttest  data  showed  that  REALTRAIN 
teams  improved  in  terms  of  casualties  inflicted  on  the  OPFOR,  whereas 
conventionally  trained  teams  did  not. 

Temporal  distributions  of  the  casualties  during  an  exercise  pro¬ 
vide  additional  insight  into  changes  in  tactical  performance.  When  the 
cumulative  percentage  of  tested  unit  casualties  is  plotted  against  the 
elapsed  time,  it  appears  that  fewer  casualties  were  sustained  early  in 
the  exercises  after  REALTRAIN  training,  in  contrast  to  heavy  early  losses 
before  training  (Figure  2) .  Conventionally  trained  units  sustained  heavy 
early  casualties  both  before  and  after  training.  Time  data,  in  associa¬ 
tion  with  other  objective  data  such  as  casualties,  can  be  used  to  measure 
what  went  on  during  an  exercise  and  what  may  have  led  to  successful  (or 
unsuccessful)  mission  accomplishment. 

Mission  accomplishment  results  showed  the  same  patterns  of  REAL- 
TRAIN  effectiveness  as  did  the  casualties.  To  accomplish  its  attack 
mission,  a  unit  had  to  clear  an  objective  of  OPFOR  elements  and  occupy 
the  objective.  To  accomplish  its  defense  mission,  it  had  to  prevent 
the  OPFOR  from  occupying  the  objective  for  60  minutes.  Figure  3  shows 
mission  accomplishment  data  for  both  attack  and  defense  missions;  each 
bar  represents  eight  exercises.  REALTRAIN  teams  improved  in  their 
ability  to  accomplish  missions  successfully,  whereas  conventionally 
trained  teams  did  not. 

Other  objective  data,  such  as  artillery  fire  planning  and  use, 
are  also  recorded.  Personnel  in  the  fire  direction  center  complete  an 
indirect-fire  data  form  indicating  the  number  of  rounds  fired,  time 
distribution,  and  casualties  inflicted.  The  example  in  Figure  4  shows 
that  "jeep  28”  was  hit  by  six  rounds  early  in  the  exercise,  but  that 
no  other  indirect  fire  missions  for  this  team  were  effective  in  this 
exercise.  Inclusion  of  these  data  further  clarifies  explanation  of 
the  overall  results. 
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Figure  1.  Percentage  of  OPFOR  casualties:  armor  test. 
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Figure  3.  Percentage  of  successful  missions:  armor  test. 
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Figure  4.  Indirect  fire  data  form 


ARMORED  CAVALRY  ENGAGEMENT  SIMULATION 

Unlike  other  ES  applications,  armored  cavalry  ES  cannot  rely  on 
casualties  as  performance  data.  "Cavalry's  basic  tasks  are  reconnais¬ 
sance  and  security"  (Department  of  the  Army,  1977) ;  cavalry  may  not 
produce  casualties.  The  armored  cavalry  platoon  gathers  and  reports 
information.  When  reconnaissance  units  withhold  fire  (e.g.,  to  avoid 
disclosing  their  positions)  r  tactical  events  may  not  lead  to  casualties. 
In  developing  ES  procedures  for  cavalry  units,  the  problem  was  to  de¬ 
velop  a  realistic  training  environment  for  the  reconnaissance  func¬ 
tions,  while  maintaining  the  objectivity  and  credibility  of  the  casualty- 
producing  ES  exercises.  Thus,  the  cavalry  ES  research  focused  on  process 
measures  and  external  factors. 

An  armored  cavalry  ES  training  program  was  designed  with  aid  from 
training  personnel  from  the  supporting  unit  of  the  3d  Armored  Cavalry 
Regiment,  Fort  Bliss,  Tex.  Research  results  have  been  reported  previ¬ 
ously  (Knerr,  Hamill,  &  Severino,  1978;  Knerr,  Stein,  Hamill,  &  Severino, 
1978)  . 

Only  2  weeks  were  available  for  the  program,  so  it  was  not  feasi¬ 
ble  to  test  all  combinations  of  missions,  force  structures,  and  force 
ratios.  The  armored  cavalry  force  was  a  regimental  cavalry  platoon 
containing  scout,  light  armor,  infantry,  and  mortar  sections.  The  OPFOR 
was  a  combined  arms  team  composed  of  tank,  TOW,  and  infantry  sections, 
with  simulated  indirect-fire  support.  For  each  mission,  the  OPFOR 
composition  was  varied  to  enhance  realism  and  provide  reasonable  oppo¬ 
sition.  The  missions  selected  were  reconnaissance  (area,  route,  and 
zone)  and  delay  (Table  1) . 


Table  1 

Platoon  Missions  by  Exercise 


Exercise 

Cavalry  platoon  mission 

OPFOR  platoon  mission 

1 

Zone  reconnaissance 

Delay 

2 

Route  reconnaissance 

Screen 

3 

Flank  guard 

Route  reconnaissance 

4 

Area  reconnaissance 

Delay 

5 

Route  reconnaissance 

Attack 

6 

Delay/defend  in  sector 

Zone  reconnaissance 

9 


In  these  exercises,  weather  and  terrain  had  strong  effects  on  mis¬ 
sion  accomplishment.  The  weather  was  clear  and  sunny,  providing  optimal 
visibility.  The  terrain  was  flat  desert,  altlvough  there  were  sand  dunes 
that  could  hide  vehicles  and  soldiers.  Moving  vehicles  were  quickly 
detected  by  exhaust  smoke  and  dust  clouds  from  the  tracks.  The  force 
assigned  an  attack  mission  or  any  moving  mission  was  at  a  disadvantage 
under  these  conditions. 

Relative  combat  power  interacted  with  other  external  factors.  Re¬ 
sults  of  an  attack  with  a  3:1  force  ratio  differ  from  results  with  b  to  1 
odds.  If  the  opposing  force  is  too  strong  or  too  weak,  differences  be¬ 
tween  the  units  may  not  emerge  because  of  "ceiling"  effects.  During 
the  first  2  days,  the  cavalry  had  reconnaissance  missions  and  the  OPFOR 
had  a  strong  composition  (main  battle  tanks,  TOW,  and  infantry) .  After 
being  hit  hard  on  the  first  day,  the  cavalry  moved  so  slowly  on  the 
second  day  that  it  made  little  progress.  It  did  send  reports  of  enemy 
strength  to  the  commander,  and  it  did  not  move  forward  in  a  "suicide" 
mission  against  the  heavy,  long-range  weapons  it  detected.  On  subsequent 
days,  the  OPFOR  was  reduced  in  size,  and  the  cavalry  was  given  missions 
more  suitable  for  reconnaissance  activity. 

External  factors  (missions,  terrain,  weather,  force  mix)  must  be 
considered  in  interpreting  mission  outcomes  as  measures  of  unit  profi¬ 
ciency  in  tactical  situations.  Figure  5  shows  the  outline  of  a  data 
form  used  to  describe  the  exercise.  The  record  starts  with  a  description 
of  the  exercise  lane  (usually  augmented  by  a  map  or  sketch) ,  weather, 
general  tactical  situation,  missions,  force  structures,  and  other  exter¬ 
nal  factors.  Next  are  notes  of  the  platoon  leaders'  plans  and  orders  to 
the  vehicle  commanders.  Complete  notes  of  the  tactical  activities  are 
then  recorded,  along  with  the  mission  outcomes.  These  notes  on  plans, 
orders,  and  tactical  activities  provide  an  overview  of  processes  (i.e., 
active  performance)  occurring  during  the  exercise. 


PROCESS  MEASURES 


Process  measurement  in  the  armored  cavalry  ES  development  was  based 
on  the  principles  described  earlier  for  the  improvement  of  observational 
measurement:  train  observers,  specify  the  behavior  to  be  observed  as 

precisely  as  possible,  and  record  during  the  action.  Observers  received 
initial  training  during  3  days  of  small-scale  exercises  that  preceded 
the  full-scale  platoon  exercises.  These  small  exercises  also  familiar¬ 
ized  the  observers  with  the  terrain,  equipment,  maneuvers,  .uid  data  col¬ 
lection  forms.  Observers  were  thoroughly  briefed  each  day  on  the  exer¬ 
cise  scenario,  operations  orders,  and  anticipated  tactical  events. 

In  the  first  exercise,  the  cavalry  platoon  had  a  zone  reconnaissance 
mission.  To  clarify  the  behavior  to  be  observed  and  recorded,  more  de¬ 
tail  was  needed  than  is  given  in  the  cavalry  Army  Training  and  Evaluat ion 
Program  (ARTEP)  (Figure  6;  Department  of  the  Army,  197t>)  .  To  perform 
effectively,  the  commander  needed  to  Know  the  location  and  status  ot 
friendly  forces  and  the  location  and  strengths  of  enemy  forces.  The 
reconnaissance  elements  had  to  learn  the  importance  of  detecting  the 
enemy  at  the  maximum  possible  range  and  reporting  the  information  to 
the  commander.  For  example,  they  had  to  provide  exact  and  timely  re¬ 
ports  on  enemy  activity  to  use  indirect  fire  effectively. 

To  support  these  training  objectives,  the  operations  orders  foi  the 
first  exercise  assigned  the  cavalry  platoon  a  zone  reconnaissance  mis¬ 
sion  that  directed  the  platoon  to  provide  early  warning,  occupy  an  ob¬ 
jective  by  a  given  time,  and  prepare  to  defend.  Theii  assignment  pro¬ 
vided  specific  elements  of  intelligence  and  coordinating  instruct  ions. 
Essential  elements  of  intelligence  included  enemy  left  in  the  area,  enemy 
strong  points,  and  enemy  ability  to  move  forward.  In  the  coordinating 
instructions,  the  unit  was  told  to  hold  at  phase  lines  and  request  per¬ 
mission  to  cross,  and  to  bypass  pockets  of  resistance.  They  were  under 
weapons-hold  status,  in  which  they  could  fire  only  with  permission  of 
the  commander.  Thus,  the  general  requirements  in  the  ARTEP  mission  were 
stated  more  specifically ,  and  observable  activities  were  defined. 

The  general  situation  described  in  the  operat ions  orders  was  real¬ 
istic  for  a  weapons-hold  situation.  As  a  result  of  this  status,  the 
vehicle  commanders  frequently  reported  enemy  information,  along  with 
repeated  requests  for  release  from  weapons-hold  status  and  consequent 
permission  to  fire.  They  used  their  reports  to  build  a  convincing  re¬ 
quirement  to  fire.  The  weapons-hold  status,  applied  in  the  highly 
motivating  ES  environment,  appeared  to  elicit  concentrated  reconnaissance 
reporting . 

Establishing  the  reporting  requirements  and  reinforcing  them  using 
the  weapons-hold  status,  made  tactical  communicat ions  a  valuable  data 
collection  vehicle.  The  reports  contained  time  and  loeat ion  information 
for  both  friendly  and  enemy  elements.  The  quality  of  the  data  was  a 
problem,  in  terms  of  both  accuracy  and  completeness,  because  of  radio 
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Figure  6.  Army  Training  and  Evaluation  Program  for  armored  cavalry  (adapted  from  ARTEP  17-55) 


rTask 


Conditions 


Training/evaluation  standards 


S  U  Remarks 


Rating 


LL-7-8. 

Make  contact. 


Threat  force  engages  elements 
of  troop. 


Overwatch  elements  lay  down  sup¬ 
pressive  fire  and  request  indi¬ 
rect  fire  support. 

Bounding  elements  deploy  to 
cover  and  return  fire. 

Elements  observe  and  report. 
Report  includes  type  and  num¬ 
ber  of  vehicles  in  Threat  force 
within  80%  accuracy. 

Elements  in  contact  request  per¬ 
mission  to  bypass  Threat  force. 
Detached  element  watches  Threat 
force  while  remainder  of  troop 
continues  zone  reconnaissance . 


Figure  6  (Continued) 


problems  and  reliance  on  tactical  participants'  skills  in  location 
reporting. 

The  two  senior  controllers  checked  the  accuracy  of  the  location 
information  provided  by  the  participants.  They  evolved  a  system  of 
radio  coordination  so  that  each  controller  knew  where  all  his  personnel 
were  and  what  the  tactical  effects  would  be  if  any  element  had  permis¬ 
sion  to  fire.  This  communication  procedure  also  gave  the  two  senior 
controllers  a  comprehensive  picture  of  what  was  occurring  in  the  simu¬ 
lated  battlefield,  which  was  useful  in  leading  the  discussion  in  the 
after  action  review  that  followed  the  exercise. 

Report  data  could  be  corroborated  in  many  instances  by  their  re¬ 
lation  to  objective  data.  In  the  second  exercise,  for  example,  condi¬ 
tions  were  established  to  create  known  situations,  which  served  as 
probes  to  test  reconnaissance  capability. 

Items  of  intelligence  interest — an  abandoned  armored  personnel 
carrier,  some  weapons,  and  an  enemy  soldier  (represented  by  a  manne¬ 
quin)  --were  placed  at  three  known  locations,  as  shown  on  the  map  sketch 
used  to  brief  the  observer  (Figure  7) .  Reports  from  one  of  the  rifle 
squads  early  in  the  exercise  indicated  that  the  squad  was  not  where  it 
should  have  been,  and  there  was  no  way  to  be  sure  of  the  actual  loca¬ 
tion.  However,  when  the  squad  reached  the  abandoned  vehicle  and  cor¬ 
rectly  reported  its  REALTRAIN  number,  it  was  certain  that  they  had 
followed  the  wrong  road. 

The  mannequin  "enemy  soldier"  also  enabled  observers  to  record 
the  location  of  tactical  events.  The  controller  recorded  the  times 
and  places  that  the  platoon  leader  dismounted  to  conduct  ground  re¬ 
connaissance.  These  estimates  were  verified  when  the  vehicle  reached 
the  known  location  of  the  mannequin  and  "took  dummy  prisoner  at  1255." 
The  observational  data  were  thus  anchored  to  a  known  location.  In 
general,  the  known  locations  clarified  records  of  tactical  performance. 


DISCUSSION 

Often  in  performance  assessment  situations,  there  is  a  strong 
tendency  to  measure  what  is  easy  to  measure.  For  example,  the  Army 
Training  Tests,  which  preceded  the  current  ARTEPs,  relied  heavily  on 
subjective  checklists  concerning  the  planning,  coordination,  prepara¬ 
tion,  and  movement  phases  of  tactical  operations.  ARTEPs  emphasize  the 
importance  of  analyzing  critical  aspects  of  missions.  The  major  tasks 
differentiated  for  each  mission  in  the  ARTEP  reflect  fundamentals  of 
land  combat  more  accurately  than  did  the  earlier  Army  Training  Tests. 
However,  extensive  training  experience  with  tactical  ES  has  demonstrated 
that  further  improvement  can  be  made  in  selecting  training  objectives 
and  measuring  their  attainment. 
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Figure  7.  Map  Sketch 


5 


This  report  has  focused  on  the  nature  of  tactical  data  attainable 
during  ES  exercises  to  acquire  objective  data  and  methods  of  enhancing 
the  accuracy  of  data.  AKI  is  also  working  on  the  improvement  of  data 
collection  and  analysis,  using  an  Automated  Tactical  Operations  Measure¬ 
ment  System  (ATOMS)  with  contractual  support  from  Human  Sciences  Inte¬ 
grated.  ATOMS  is  comprised  of  data  collection  instruments,  associated 
data  collection  and  reduction  procedures,  and  a  software  package  for 
summary  descriptive  statistics  from  which  further  analyses  may  be  made 
(Epstein,  1978;  Root,  Knerr,  Severino,  &  Word,  1978) . 

The  inherent  difficulty  of  measuring  complex  human  performance  in 
a  field  environment  is  one  reason  for  the  shortage  of  satisfactory 
methods  for  unit  performance  measurement  (Wagner,  Hibbits,  Rosenblatt, 

&  Schulz,  1977).  The  methodology  described  here  depends  on  a  detailed 
statement  of  training  objectives,  objective  observation  and  recording, 
analysis,  and  explanation  in  sufficient  detail  to  show  how  and  why 
outcomes  such  as  mission  accompli sliment  (or  lack  of  accomplishment) 
occurred . 
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1  Oli  A*st  Sect  4»t  Hie  Aimy  (HAD) 

I  I  ech  Suppoi  t  Olr  OJCS 
I  USASA.  Arlington  ATTN  I  AND  I 
I  USA  R*ch  Olr.  Durham,  AT  IN  Lite  Science*  On 
?  USARIFM.  Natick.  ATTN  SGRD  Ul  ('A 
I  MSA  I  TC  111  l.iyioti.  AIIN  !.  I  111  MO  A 
I  USAIMA.  Ft  lb. him  AIIN  AISUC10OM 
I  USAIMA.  Ft  Bi aqg,  A T TN  Mjinu.it  l  il> 

I  US  WAC  Cti  &  Sell.  F  t  McClellan  ATTN  l  ill 
I  US  WAC  Cti  A  Scl*.  1 1  McClellan.  ATTN  Tni|  On 
1  USA  Quartermaster  Sch,  F  t  Lee,  ATTN  ATSM  TF. 

I  I m ti*l lujoru  t*  Mjt»*i  jl  Drv  Olr,  FWt,  Ft  Hnlehird 
t  USA  SE  Snin.il  Srh  I  t  Gnnlnn,  ATTN  ATSO  LA 
I  USA  Chj»*l.i*n  Cn  ft  Srh  I  i  M.iiu.lton.  ATTN  ATSC  TF  HO 
I  USA1SCM  f  i  I  usti*.  AIIN  Filur  Advitur 
1  USA  War  CoIIimh*  Carlisle  Bji tacks.  ATTN  Lit* 

WRAIR,  N.  Hiiupsyrlii.iii  y  ().v 
I  Dll  SOA  M*»*. terry 

t  USA  Concept  Anal  Agey  Rethe*da.  ATTN  MOCA  MR 
I  USA  Comvi*t  Anal  At|cy  Itetheida.  ATTN.  MOCA  JF 
1  IISA  Arctic  Test  Ctr  APO  Seattle.  ATTN  STFACPl  Ml 
t  USA  Arrtn  Test  Ctr  APO  Seattle  AIIN  AMSTE  PL  TS 
I  USA  Armament  Cmil  Redstone  Arsenal,  ATTN  ATSK-TFM 
I  USA  Armament  Cmd.  Rost  Islanit.  ATTN  AMSAR  TOC 
1  I  AANAFFC  Atlantic  City,  ATTN  Library 
I  FAANAIfC  Atlantic  C*ty  ATTN  Human  I  ngr  Bi 

1  F  AA  Aeronautical  Ct».  Oklahoma  City,  ATTN  AAC  440 

2  USA  fill  A.ty  Sch.  Ft  S.II  ATTN  I  ihiaiy 
I  USA  Armor  Srh.  F  t  Kno*.  ATTN  L.lnaiy 

I  USA  Armor  Srh,  F  t  Kuo*  ATTN  AT  SB  01  F 
I  USA  Armor  Srh  I  t  Knos  ATTN  ATSH  OT  TP 
I  USA  Armor  Sch  fthnn»,  ATTN  ATSH  CD  AO 


7  MOUSACDEC.  F  t  Old.  ATTN  Library 

1  MOUSACDEC.  Ft  Old.  ATTN  ATEC  EX  E  Him*  Facto.* 

2  USAEEC.  Ft  Benjamin  Harmon.  ATTN  Lilttaiy 

1  USAPACOC.  Ft  Beniamin  Harmon.  AT  TN  A  TCP  HR 
1  USA  Comm  Elect  Srh.  Ft  Monmouth,  AT  IN  ATSN  FA 
1  USAEC.  Ft  Monmouth.  ATTN  AMSEl  Cl  MOP 
I  USAFC.  Ft  Monmouth.  ATTN  AMSEL  PA  P 
t  USAEC.  Ft  Monmouth.  ATTN  AMSEL  SI  CB 
t  USAEC.  Ft  Monmouth.  ATTN  C.  Feci  Dev  Bi 
1  USA  MaterialsSy*  Anal  Agcy.  Abeideen.  ATTN  AMXSV  P 
1  Idgewood  Arsenal.  Abeideen.  ATTN.  SARFA  HL  M 

1  USA  Oul  Ctr  &  Sch.  Aberdeen.  ATTN:  ATSL  TEM  C 

2  USA  Hum  Engr  Lab.  Alien  Iren.  ATTN  litHary/Oir 

I  USA  Combat  Arms  Tug  Bd.  F  t  Benmng.  ATTN  Ad  Su|ietvisot 
I  USA  Infantry  Hum  Rscb  Unit,  Ft  Benmng,  ATTN:  Cbict 
1  USA  Infantry  Bd.  Ft  Banning.  ATTN:  ST EBC  IF  T 
I  USASMA.  Ft  Bins.  ATTN  ATSS  1  RC 
1  USA  A..  Del  Sch.  Ft  Bln*.  ATTN  ATSA  CTO  MF 
I  USA  Ah  Del  Sch.  Ft  BI.**,  ATTN  Tech  Lib 
I  USA  Air  Del  Bd  f  t  Rim.  ATTN  FILES 
1  USA  Air  Del  Bd.  Ft  Bln*.  ATTN  STEBO  PO 
1  USA  Cmd  ft  General  St*  College.  Ft  Leavenwoith,  ATTN  l  ili 
1  USA  Cmd  &  General  St*  College.  Ft  Leavenworth,  AT  TN  A1SW-SF  l 
I  USA  Cmd  &  General  Stf  College.  F  t  Leavenwnrlh,  ATTN  Ed  Advisor 
I  USA  Combined  AnmCrnbt  Oev  Act.  Ft  Leavenworth.  ATTN  DupCili 
I  USA  Combined  Arm*  Cmbt  Dev  Ai  t.  Ft  Leavenworth.  ATTN:  CCS 
1  USA  Combined  Arm*  Cmbt  Dev  Act.  Ft  Leavenworth,  ATTN:  ATCASA 
I  USA  Combined  Arms  Cmbt  Oev  Act.  Ft  leavenworth.  ATTN  ATCACO -E 
1  USA  Combined  Arms  Cmbt  Oev  Act.  Ft  Leavenwoith  ATTN1  ATCACC  Cl 
I  USAF COM.  Night  Vision  Lab.  Ft  Belvon.  ATTN:  AMSEL -NV  SO 
')  USA  Computer  Svs  Cmd.  Ft  Belvon.  ATTN  Tech  Lihreiy 
1  USAMEROC  Ft  Belvon.  ATTN  SI SFB  DO 
1  USA  Eng  Sch.  Ft  Belvon,  ATTN  Library 
1  USA  Topograph*,  lab.  Ft  Belvon.  ATTN  FTL  TD  S 
1  USA  Topographic  Lab.  Ft  Belvon.  ATTN  SfINFOCentei 
I  USA  Tointgiaphic  lab.  Ft  Belvon.  ATTN  F  TL  GSL 
I  USA  Intelligence  Cn  ft  Sch,  I  i  Huachncj,  ATTN  CTO  MS 
I  USA  Intelligence  Cti  ft  Sch.  Ft  Huacbuca.  ATTN  ATS  CTO -MS 
1  USA  Intelligence  Cti  A  Sch.  Ft  Hoochura  ATTN  ATSI  TE 

1  USA  Intelligence  Ctr  ft  Sch.  Ft  Huachuce.  ATTN  ATSI  TFX  GS 

I  USA  Intelligence  Cti  A  Sch.  Ft  Huachma.  ATTN  ATSI  CTS  OR 

1  USA  Intelligence  Ctr  ft  Sch.  Ft  Huachuce.  ATTN  ATSI  CTO  OT 

1  USA  Intelligence  Ctr  A  Sch.  Ft  Muachoca.  A1TN  ATSI  CTO  CS 

t  USA  Intelligence  Cti  ft  Sch.  Ft  Huacbuca,  ATTN  OAS/SRO 

I  USA  Intelligence  Cti  A  Sch  Ft  Muachoca.  ATTN  ATSI  TFM 

1  USA  Intelligence  ('ll  ft  Set*.  Ft  Huacbuca.  ATTN  l  deary 

I  COR.  MO  Ft  Huacbuca  ATTN  Tech  Ret  Oiv 
7  CDR.  USA  Electronic  PrvyGrd.  ATTN  STF  FP  Ml  S 
I  HQ.  TCATA.  ATTN  Tech  l  ihraiy 
I  HO.  TCAT  A.  ATTN  AT  CAT  OP  O.  F  t  Hood 
1  USA  Reciinting  Cmd.  Ft  Sheridan.  ATTN  USARCPM  P 
I  Senior  Army  Adv  .  USAF  AGOD/T AC.  Elgin  AF  Aim  Flit  No  9 
I  HQ.  USARPAC.  OCSPER.  APO  SF  96558.  ATTN:  GPPE  SI 
I  Stimton  Lib.  Arademy  of  Health  Science*.  Ft  Sam  Momton 
1  Marine  Corp*  ln*t  .  ATTN:  Oeen  MCI 
1  HO.  USMC.  Commandant.  ATTN  Code  MTMT 

1  HO.  USMC.  Commandant.  ATTN  Code  MPI  ?0  76 

2  USCG  Academy.  New  l  ondon.  ATTN  Admission 
2  USCG  Academy.  New  London.  ATTN  l  tbrary 

I  USCG  Training  Ctr.  NY  ATTN  CO 
I  USCG  Training  Cti.  NY.  ATTN  EducSvcOlc 
I  USCG.  P*vchol  Rr*  Bi  .  DC  AT  TN  C»P  1/67 
1  MO  M.d  Range  Rr  MC  Oet.  Quenbco.  ATTN  PAS  Orv 
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1  Def  Hi  Civil  In*!  of  Enviro  Medicine.  Canada 
1  AIR  CRESS,  Kensington  ATTN  Into  Sy»  B* 

I  Militaerinykolognk  1  lenette.  Copenhagen 
I  Mihuiy  Attach#.  Fitnch  Embassy  ATTN  Doc  Set 
1  Mcde«  m  Clt*l.  C.E  R  P  A  Aitenal.  Toulon  Naval  I  umhv 
1  Pi  in  Scientific  Off.  Aih'*  Mom  Engi  Rich  On.  Ministry 
ol  Defense.  New  Delhi 

\  Pen  Rich  Ofc  Library.  AKA.  luael  Offense  Tout's 
1  Munster  is  van  Defentie.  DOOP/Kl  Afil  Soci.nl 
Psycholoqiicfie  7aken.  Tht  Hague  Nfther lands 

I  USA  An  Del  Srh.  Ft  Bliss  ATTN  ATSATFM 

I  USA  An  Mohihiv  RmIi  A  Dev  Lab,  Moffett  fill.  ATTN:  SAVDl  AS 

I  USA  Aviation  Sch.  Rv%  lug  Mgt  ft  Rucker,  ATTN  ATS1  T  RIM 

I  USA  Aviation  Sch  CO.  Ft  Rucker.  ATTN  ATST  D  A 

1  MO  DARCOM.  Alexandria.  ATTN  AMXCO  TL 

I  MO.  DARCOM.  Alexandria.  ATTN  COR 

I  US  Military  Academy,  West  Point,  ATTN:  Sfiials  Unit 

I  US  Military  Academy.  West  Point,  ATTN  Ofc  of  Milt  lilnlip 

l  US  Militai y  Academy  West  Point  ATTN  MAOR 

»  USA  Stamf.mli/ at  mo  Gp.  UK  f  PO  NY.  ATTN  MASf  GC 

I  Ofc  of  Naval  Rich  Arlington.  ATTN  Cmie  452 

.1  Ofc  of  Naval  Rsch  Arlington.  ATTN  Code  45R 

I  Ofc  of  Naval  Rsch.  Arlington.  ATTN:  Cor  te  450 

I  Ole  of  Naval  Rsch,  Arlington,  ATTN  Coile  44 1 

I  N.iVvil  Aemspc  Med  Res  l  ah  Pensacola.  ATTN  Aeons  Sch  D»v 

l  N.iv.il  Aaio\|tr  Mril  Res  1  ah.  Pensacola.  ATTN  Code  151 

I  N.iv.il  Aarospc  Med  Res  l  ah.  Pansacola.  ATTN  Cod#  1.5 

1  Chief  of  NavPbrt,  ATTN  PeivOR 

I  NAVAIRSTA.  Norfolk.  ATTN;  Safety  Ctr 

1  N.iv  Oceanographic.  DC.  AT  TN:  Coda  0251.  Charts  ft  Tech 

1  Center  of  Naval  Anal,  ATTN  Ooc  C.b 

I  NavAnSysCom.  ATTN  AIR  53 IX 

T  Nav  BuMed.  ATTN  713 

1  NavHa Mcopta i  SubSqua  2.  TPOST  9660 T 

1  AFMRL  (FT)  William*  AFB 

T  AFMRL  |TT)  Lowry  AFB 

1  AFMRL  (AS)  WPAFB.  OM 

2  AFMRL  (00.12)  Brooks  AFB 

\  AfMRL  (DOJN)  Lackland  AFB 
1  MOUSAF  (INYSD) 

I  MQUSAF  (DPXXA) 

1  Af  VTG  (RD)  Randolph  AFB 

3  AMR l  (ME)  WPAFB  OM 

2  AF  Inst  of  Tech.  WPAFB  OM  ATTN  ENF/SL 
f  A TC  (XPTO)  Randolph  AFR 

I  USAF  AeioMed  ( ,h.  Brooks  AFB  (SUL  41  ATTN  DOC  SEC 
I  AFOSR  (Nl  I.  Arlington 

I  At  LoqCmd .McClellan  AfH.  ATTN  ALC/DPCRB 
T  An  Foret  Academy.  (  O  ATTN  Dept  ol  Btl  Sen 
5  NavFVis  A  Dev  Ctr.  San  Diego 
i  Navy  Mesl  Neumpsyvhiatnc  Rsch  Unit.  San  Diego 
1  Nav  f  lectiomc  l  ah.  San  Diego  ATTN  Res  Lah 
1  Nav  TrngCeo.  San  Diego  ATI  N  Code  9000  Lih 
\  NavPmtGiaSr  I*.  Monteu'y  AT  TN  Code  55Aa 
1  NavPostGraSch.  Monteiey  ATTN  Crxfe  7124 
1  Nav  TmgFquipCtr.  Orlando.  A TTN  Tech  Lib 
1  OS  Dept  rst  Laboi,  DC.  ATTN  Manpowei  Admin 
1  US  Dept  of  Justice.  DC.  ATT  N  Duig  F  nfoice  Admin 
1  Nat  Bur  of  Standards,  DC.  ATTN  Computer  Info  Section 
1  Nat  Cleat  ms)  Mouse  for  MM  Into,  Rockville 
1  Oepver  Fevfetal  Ctr.  I  akewood,  ATTN.  BLM 
17  Defense  Documentation  Ctnttr 

4  On  Psych.  Army  Hq.  Russell  Qfcs,  Canberra 

1  Scientific  Advsr.  Mil  Bd.  Army  Mq.  Russell  Ofcs,  Canberra 
1  Mil  anrt  Air  Attach#.  Austrian  Embassy 

1  Centie  da  Recherche  Des  Facteurs.  Mumame  rfe  la  Oefense 
Nalionafe,  Brussels 

2  Canadian  Joint  Staff  Washington 

1  C/Au  Staff  Royal  Canadian  Af.  ATTN  PersStst  Anal  Br 
J  Chief  Canadian  Del  Rsch  Staff.  ATTN  C/CROSIW) 

•1  Rutish  Det  Staff  R» dish  Embassy.  Washington 


f  US  Marine  Corps  l  laiton  Ofc.  AMC.  Alexandria.  ATTN  AMCGS  I 
1  USATRADOC,  Ft  Monioe.  ATTN  A1RO  ID 
B  USA TRAOOC.  Ft  Monroe.  ATTN  ATPR  AD 
t  USATRADOC.  Ft  Monroe.  ATTN  ATTS  fA 

1  USA  Forces Crml.  Ft  McPtser  son  ATIN  l  ihtary 

2  USA  Aviation  Test  B«l.  Ft  Rucker  ATTN  STFBG  PO 

1  USA  Agcy  for  Aviation  Safety  F  i  Mucker.  A1  IN  Liltraiy 
I  USA  Agcy  tor  Aviation  Safety.  Ft  Ruckei  ATTN  Educ  Advisor 
1  USA  Aviation  Sch  Ft  Rucker.  ATTN  F*0  Dr  awe*  O 
1  MOUSA  Aviation  Sys  Crml.  St  Loins.  ATTN  AMSAV  7DR 
7  USA  Aviation  SV\  Test  As  t  ,  F  dwauh  Af  R.  AT  IN  SAV  TF  T 


/o 


